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ABSTRACT : PROBLEM TO BE SOLVED: To provide a three-dimensional shape information input 
method, system and image input device thereof by which a corresponding point is 
automatically and efficiently designated. 

SOLUTION: A computer 104 selects plural points extracted from an object 103 in a actual 
photographed image obtained by photographing the object 103 with a stereoscopic 
photograp device 100 and decides a 3-dimensional coordinate system of the extracted 
positions to configure the shape information of the object. A right eye image and a let eye 
image are separately given to right and left eyes of a viewer 106 respectively so as to 
enable the viewer 106 to stereoscopically view the left and right images displayed on a 
stereoscopic image display device 105. A sight direction sensor 1 07 senses the direction 
of a sight line of left and right eyeballs of the viewer 106 in the stereoscopic vision state 
and the computer 104 calculates the three-dimensional coordinates of the extracted 
points, based on the sensed sight line direction information. 
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a = arcsin(dxXCl)-C2 ••• (1) 
H*tC. .frBlOgE*^0?S^Jgb{4. ■SL+'tCfc 

3. C4^Hth LTTi£5^2c04'}(c*^?.. 
[006 2] 

b = ar c s i n (dyxC3) -C4 ••• (2) 

ci, 2 , c 3 , c 4 ffmsEmt. &fflAcotmmiti?f 
Mmtz—mffMihWEfmtzi ^xmm$ft&> z<r> 

wgiz&m $ it . -e » ^ » ««i w * »*f -r * i 

[0063] ULh^aSte&iOlK^tcov^Tff 3 CI t 
(c4 0 . Ic^B^coS^I^^^I. ^ i: WX% h . 

[0064] *HiftOJg®Tt4. 06O?S«a«StB[HlS86 
OST'dx, dyO^ffiO^^tfo, dx, dylll 
SST-'-^iUff BK6 0 9(c4 0 3 yt°j.-^ 1 0 4(ciM 
^il. 1^3 yfc-j--^ 1 0 4fflJc07°o^7AT±lfi^ 1 
S(/2«:2 0fta^fi : Jbix^. LA^L. 3ytx-?10 

4 dl07*o 7" 5 i.t±E^ 1 S.^^ 2 OH-®: Zfrb-f 

tnr^ajniifS6 o sffl)iT'±fa^ 1 Rv^cotmt: 

[ 0 0 6 5 ] MTvmmz&^x . m^tB^B 
1 0 7*>^>aj^$ii^»f--^*miS7 ; '-^tiif^. flp 

*>. .tKJSS 0 3(co^T£7)®TL4"DCi;ftBiia^it"i:> 
Oi:oraco* ;s F*|fi]8ESIS.lXSiI^|fiiggg| ( dx_ 1 , 
d y _ 1 ) . LT . ^mm3 0 4 (COV^TCOttTL^ 

Sl(dx_r, d y _ r ) 1 WZ t (C 

[0066] *»fiomffi.T'{4. A#:ffifiia^S 1 0 

5 fcffi&ttm&xi o 7 ttf-tefozi\fz$mgmm.v> 

±&m®M^£S.l 0 5 5rffli^A\ >Iili4ii:«:B(iS 

i o 5 tmm%mn&&mv>ttmwi}mm2 
it. mm£<%3&mm<nmiiitf?rz.2>frt>xfoz>. t 

^tU^Hl 0 7 1 &E\*tzim Ltt 4 w EP*>. 4Hs 
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x i, 4 < . immiamwamizim^mm-f^ tv>om 
f&<,z£->xi>. *~$tmm% izmm^mx'h h . 
[0067] mz*mmmmiz&&E.&mmmmA 
-ftmwizx vEjxmmmmzK^h^miz^x . 

[0068] B^«»tftffl<offlHI^T»EL*: 4 5 

T77S90 1 X'ffi&tk&lZfflfr&ffilEWm&'ifo . ^ 
>t^-^104 {±ffliEm«0S^3rji*ll#^^S 1 

§ . MtK^ttSIX 1 0 7 «^jiaj$il^^7-'-^ d 
x, d y 

[0069] §SK<D3t^tffiB, BP^>- nm*&*tl*& 
*g Lfc*£«>«t»ft* a , b {4 . jOI^ifC fc 0 . i 

h, ^(rffismtxmztt* 2$<mfcx^x.x'% h 

[oo7o]^f7rs902 x'±imm.mmiMm 
loo, £fcii&tmmmmztLtzimmft2 o 

4»3i#:®#y-*-^5:0g^iitf, £ttB&JM$3£Kl 0 0 

,tiigg&2 o i Jiunyt'a-^ i oAcomm^^'J 
mmm 1 o o izmmztx.&y^jfA-t* 5101, 10 

[007 1] ^'J7;H^-7x-XSttfflt4* 

B*fiifi#A^is]K2oi«^'jr/HH]^jiai^M-e 

flMI^A*Jll]»2 0 ltiTtn^/fy^.«« 

Bt-fc & . *sk*t 4 2-9 m<?>mmw 208* £ ^ 

ffi&x- * SrM^&tf . AftMr - ?<4 3 >- b* jl 
1 0 4<0^Ba«Hfc LT^$tL^ieii«K«sA^il 

(4, fWyt A -^i 04KSE^a*n., ^-Kf< 

(4, M-Kf*4 AftPbWk**. X )2Q 3±tir*B« 

[ 0 0 7 2 ] wm* * 'J 2 0 3±*Cftft»r-*a«Bl 

hi 0 5tas*«*t*. cowmwou £*H«s-f 

> X-£fi£L. NTSC^f V9-V-7<m^h L 



T£tt®f$ffe^®l 0 5lciii7J-f 
[0073] £f4«=3l^M 1 0 5"Ct4, ^C7)NT S 
CM >*-U— #SiU * 

@ffl«LCD6 0 3J: £ SffiO LCD603C. -Hl-e 

T{>4^.> 

[0074] ELtlC J: 0 . ±tmm$&rgm 1 0 5 C± 

[0075] mzX"r y y S 9 0 3T'3> t" jl-* 1 0 
4 0>K)MWX*fo l>^"7X206g54\, »(4^r- K 2 0 
imz&&W^ii>h<r>X%tffohii*£ii>$: ?.jitffr$> 

{4 , Xf y 7' S 9 0 4 T'S##^ ^iOA+l x - 9 

L , t«l*!ii^»:«Xf 77S90 5 X*=&7Cimffi 

»:7C^«fflfEA*^T2rt^ L fc*&ti . *«M«f^ 

V H&7Cfl£Ktil$BA7J * hWS^f>f\X \ ^ 

3tf*T-*«iSiW^2:^T-rs 4d^tri>4v\ 
[0076] -~H. WKX-f-vTS 9 05tt>V^M 
ATl^T ^Ji^ L=S:i^*^-{±. <J:OXf y 7°S 9 0 6 

. HiXTcff^wig t ffifco* jftrfiarc # s i a k 
{4, mt¥mi)mi¥**mvfz^&mcom&x\ m&tx- 

?^iett«f*fc:R# L-^t*, Byiexf-vr s 9 03^ 

[0077] — ^T, BdlE^X-yTS 9 0 6 tfct >T3&£ 
£7)H^7C^«ffl f L 4 V ^1-^(4 , Xf -y T 

s9 08^iiAT-, ttflHAmjjmjg. sn*>, aMMw^si 
BW.zm®mf&m&. t Lxmm-t& z t s-t^ lt v ^ 

T ^^T V >*§-^(4 BtfffiX f':'TS9 03 'vR 0 , i , ill 

xm&T-9W%tmmmM\%t ziio . «tK»assi 

El 0 7^^(4»?-'-^A^aa6^(,ci*ft$ix, aytr 
j.-^ 1 0 4^l*r-^A^0S^2 0 5(c4^>-CgfI 
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?A*EISS2 0 5(C^fi$ii/>fi|^>M&x-?*: 
KASB-tftifiV^. ItfSx-^imSii&k, /xifj-m 
-fiUco* , ffifBsK 1 2 Cftoxmif&ft&^Stai 
ddt', mlE^l.&tX^20ttiE3SliBaISXx 
y r s 9 o i izt-i t ifei: $ tix \> ■> & , 

[0 078] d <fc o£ L T L , 

^^S£^8ifc£rt>*Jfl£3*.S k . .XT 7 rs 9 
1 0 TifiHl6H»:7G!£»0>St ttJ $r :j , huI£.X -f y 7° S 
9 0 9 fcfc i- >T f# 4>ix^^^1Si«ft JKJi . TIE* 3 - 

[0079] Xl=Lxtan (al) ••• ( 3 ) 
YI=Lxt an(bl) ••• (4 ) 
Xr = LX t an ( a r ) — ( 5 ) 
Yr = LXtan(br) ••• ( 6 ) 
ZZX\ a 1 , hi, a r , b r , XI, Yl, Xr, 

y r . LvmmwTnm o r& & . 

[ 0 0 S 0 ] a 1 : :SUi#:fctt«Y|ttCtt-f SHfe^ 

b r : timmimnxmiztt-tzm&fim 
x i : tEgmmm±.x<r>miti&e>xmw ! 

Y 1 : £BHfflflLLT'<*>ttffijS?>Y,!£« 
Xr : feBfflaa±-CW»ajjS«OX«ffi 

Y r : £BfflH«±T<>>ttajj£<DY£« 

&&®#.jK0~%7Cffi^£0ffl (XI. Yl), (Xr, 
Yr) A^, H^7n^*T-^ttttS*OH^7cffi« (X 
c, Yc, Zc) #\ TIB^7— ^9tcJ:oTf#feil 

£. 

[00811 Xc=Xlxt - (7 ) 
Yc=YlXt ••• (8) 
Zc = Lxt ••• (9) 

i^t, tlit = D/(Xl-Xr) tfcm*ti. Dii 

[oos2] mz^T rs 9 1 1 /xjtx/e, miexf 

7 7'S 9 1 OC43^-C^I&SiTJC:ttaijS^=<JC7cMl[ 
(Xc, Yc , Zc)li, ftftfl£K£jeJt*-&*ft:fclI 
&t LXEftKBVz7-'-?^mf\Ziitz&. pfKXx-y 

rs903^, HfrifiH^Tc^^-^ti, ii otc 

I , i <^*£ll£^fl-;fc' WAS L -fefltJfi k 2ro T V % 
y 7 h *} x TO^-ff Tti , i <r> i ? 5r«3Itt 

kt-ti. E&Kmwmt Lxmztcmi&SEM. m 

aitfWi, =» >' fj.-^ 1 0 4er.mi&*± >J 2 0 3± 
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[0083] PJLfcK: i o T . «» ATI $mm LfcHiWc 

[ o o 8 4 1 ( 2 omtwmm. > &<c , ^.whdsb 2 

^dl^jB^BI 1 l SIXH l 2 IftHflf -S . 

[ 0 0 S 5 ] ±j£Vfcf& 1 *>SIIIStfSf»BK:iMt*3JC7E 

x 2 0 6^*-*- k 2 0 7 Jf?<?;> A2ii£E£teffl ITU 

ttm&£jk(cjk& -o fc i k Sr - »f&W t *0>&&Sm 
lbj!ttz*A,t* k ^JBr-Tiitf i i * . 

[ 0 0 s 6 ] ^mmommu. z 0 izm^wmz 

&WKk-t&£o(£l-tei>(?)X\ ^O^SrHl lRt/m 

[ 0 0 8 7 ] Ull (Ciilt^Xf 77S 110 

1, Xf'yrs 110 2, Xf -y/S 1 1 04-Xf-y 

rs 1 1 o 7a^f7rs 1 1 1 sii, mi<vmi&v> 

S 9 0 2 , .7>f 77S 9 0 -v 7°S 9 0 

T77S9 1 UH-mK. -t^l^JieiSL. 

[0 088] HI Hz&^XM9bm%:2>&lZ. 

1 0 3X^{f%fr^cr>Xfttfm>M-£li. Xy'-yTS 1 

i o 8x°m®eom& j r-?cr>m.nfrt>— m^fssm&i-tz 

5S«#iaeiftLfc*&«, Xf7/Sl 1 0 9T« 
^iOlRtfSr^f-o^-f*, J^c7)X^y7 0 Sl 1 lOT'H 

[ o o s 9 ] wt, Mie7.-f 7 7'smo tc^v^n 

[0090] "fib: N s am p 1 e fflcom^r-^^fS 
[0091] tf, XT77S1201 *7 V^S^t 

xf 77s 1 1 1 otztsif ^mmmm^Mmnm^ ?>v 
-^y^mwomrrm. m-h, *>>^sasn*«f0j 

c7)^-{i., Xf77S 1 2 0 9 y \jlAT', =3 >'t"jL— ^ 
1 0 4<7)iS|gr-?A71®S§2 0 5*-^S^#L-^gtS 
If-^ ( d x_ 1 , d y_ 1 ) k^&S^x-^ ( d 
x_ r . d y _ r ) k * , HUlHl^lS-r'-^ k LT«»f 
-^S5>J<^5tfflCtS#lL. *-7>-^^n(C rij £ft 

al, ;^xf 7/s i 2 i o-e»a£5l5£7^'£ 
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[0092] ^0c^^^«iaj*it^J»r-^y/l'-^-> ^ 

•y7"S 1 2 0 2'\>ft/vT, MHtSlrtL*:^^-*, BU 
*>. «»-r— ^K5"J4>. nSB^HJR^-^ (dx_o 
Id. d y_o 1 d ) tWt£0)®.& : r-? ( d x_ n e 



w . d y _ n e vv ) t srJt^ L , 2 £|Si<7)?US8$rTItii*: 
1 OCiO^S, Bt»«fc*ii(cas-?<«KIJ. -IE 

[0093] 
[ftl] 



\ (dx_new— dx_ol d) 2 + (dy_new— dy_ol d) 2 — (10) 



3WC.7. T77S1203 T'B«IB3« 1 0 K i 0 h tttz 

3I®)« — j£&«ttfl«:: AoT^'l. 7.x>/7*S 
1 2 0 4 -PBStf)lSf- * £ , flMfrr — ?K? | I4» , 13 

mtmtmo&oimMm l . nmz* >■ ?%t®. n 

£ r 1 J if^->LT, amrvrs 1 2 0 5'vittf, 
[00 94] 1 2 0 5T14, ^y^SERn 

//Nsamp 1 efcLbWSj&M&fflBW - *. -f LT, ij*J 
>'«Sn*!Nsaip 1 elli^Ji. ^m^=T-/ 
7S1 206 -C1S»T-*ii^fc*&W3*lfcN samp 
1 e m<n&SW^."f—9 ( d x_ 1 , d y _ 1 ) s ( d 
x_r , dy_r) <?>T^fflS-?-n-riltH£t , ftlitJ* 

iC*t"f hW&.'T— -9 ( d x_ 1 _m , d y _ 1 m ) _ 

(dx_r_m, d y_r_rn) i: LTieif-f 
[0095] mzXrvTS 1 2 0 7 T'«liii."&i5E 7 5 
r Kj CSJ£U »Wf77S 1 2 0 8t«<7)tt 
ai^=«i&^<^'7>'^»nSr^DJ«fi r 1 j tR 

[00 96] -7f, tulB^T-vrsl 2 0 3t*5^T15 
1 0 <fc O&lhbtltiVmtf L # t vfilJ; 

L, Xf77S 1 2 09MAt*9>-^in$|l]« 
fit r i j (cML, S4«8«f-^*. mfHI^r-^ 

[009 7] ifc. miBx^ yrs l 2 0 5i:fc^t* 

7S12 1 0'^jtA,T', r iSj IZWt 

-f->'£*n'-*"* t , fft>"H 1 1 lz^jk-?*4 >-7o-tc 
MoT, Xf77S 1 1 1 lTttaj.#.li^7 9^3&« 

r«j T*S*£ti. «Jffij£l45I^L*kO£«rU 
^T77S 1 1 1 2 ^3te/L T' HUiet* Hi.^Sl^^'IlSf 
7)V-*vizx%m%ixrz^mt%ixrzm%'r-* ( d 

x 1 m , dy 1 rn ) , (dx r rn, dy 

r_m) fcfflwt, WMmmkmijB3&3iMM<0 
gaj£ffofcf&. ^f77S 1 1 1 3'^1AT\ m 



XT77S111 2(Cti*t4^flJKft*4:«lffl.£Ha: 

7cffi«4>jr a»4 . ±ii L/i* i <7)mm<mm t m t 

[0099] £fz. HUie7>T-:/7°S 1111 fctJtvCtt 
S 1 1 0 3'^M&* 

[0100] tiJic7jj; o(c*^M^®^SSH<5:7n^ 

[oioi] (%<7m<7?m&<mm) ±mttzm 

-T^m^-^^EISLTtJt, HuISUl 2(D7f77 
S 1 2 0 6te*3VvCKfl*«0«a-r-*<W&fi£9t*: 
LJtfA. iXfOA-r 7 7S 1 2 0 7^.jitffflf^SPgt~io^ 

t , a^fciw^ i .fcttffi£<o«»T-* «fc o s +%-m* 

+^^^5: & «»t - ^ T'A £ %&\,zWhX 7, f -v 7° S l 
2 0 7t;:fc^T»ajj55IVt7 7?'£ r^j (cfSigLT. 

[010214*:. -jS£*"$ISW.o*>fc*a. Ht* 

iO^rffitLTii, HI ltSt^'f > 7o— <f>7.t»/T 
Sill 3fc«»t&=»5c»ttr-^'v^)iiJlwaB 

[0103] Z<?>£ oWMzXmf. ±3£Lfzm2CD 
[0 104] 

ttJ^Srli^S LTV v< feW=»5cm«ffi««A^ff 
fi^7fS«t, ££®&£jUt'NT, 171 
OMlD.i[^ -7 »7 7,*Tt&lE L T V^c f^(CJt^l> i: , fl? 
ISD#faat/|«I#:6^ffi^M®(cfcV>T , **i4>*y«t 
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